Partial Likelihood for Real-time Signal Processing with Finite Normal Mixtures
نویسندگان
چکیده
We introduce a unified framework for nonlinear signal processing with finite normal mixtures (FNM) by using maximum partial likelihood (MPL) theory. We show that the equivalence of MPL to accumulated relative entropy (ARE) minimization is valid for the FNM. Then, we define the information geometry of MPL and use the result to derive the em algorithm for distribution learning based on the FNM model. The superior convergence of the em algorithm as compared to the least relative entropy (LRE) and the backpropagation algorithms is demonstrated by simulations. We also discuss the performance of the FNM based equalizers with different number of mixtures and observation vector sizes.
منابع مشابه
Penalized Partial Likelihood for Sequential Order Selection
We have recently shown that partial likelihood estimation of finite normal mixtures (FNM) yields very efficient estimators and hence provides a very attractive solution for real-time signal processing. Order selection, however, is a very important factor affecting the overall performance. In this paper, we address the problem of order selection for the FNM model in applications requiring sequen...
متن کاملSequential Order Selection for Real
In this paper, we address the problem of order selection in signal processing applications for the general case where the observations can have correlations in time and require sequential processing. We consider the finite normal mixtures (FNM) model as an example for which correct order selection is very important. We derive penalized partial likelihood as the information theoretic criterion f...
متن کاملWindowing Effects of Short Time Fourier Transform on Wideband Array Signal Processing Using Maximum Likelihood Estimation
During the last two decades, Maximum Likelihood estimation (ML) has been used to determine Direction Of Arrival (DOA) and signals propagated by the sources, using narrowband array signals. The algorithm fails in the case of wideband signals. As an attempt by the present study to overcome the problem, the array outputs are transformed into narrowband frequency bins, using short time Fourier tran...
متن کاملWindowing Effects of Short Time Fourier Transform on Wideband Array Signal Processing Using Maximum Likelihood Estimation
During the last two decades, Maximum Likelihood estimation (ML) has been used to determine Direction Of Arrival (DOA) and signals propagated by the sources, using narrowband array signals. The algorithm fails in the case of wideband signals. As an attempt by the present study to overcome the problem, the array outputs are transformed into narrowband frequency bins, using short time Fourier tran...
متن کاملA Time-Frequency approach for EEG signal segmentation
The record of human brain neural activities, namely electroencephalogram (EEG), is generally known as a non-stationary and nonlinear signal. In many applications, it is useful to divide the EEGs into segments within which the signals can be considered stationary. Combination of empirical mode decomposition (EMD) and Hilbert transform, called Hilbert-Huang transform (HHT), is a new and powerful ...
متن کامل